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result of altered teacher behavior? Each concern' can .b€ integrated 
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The professional development of teachers' through locally developed 

" w „ 

* inservice 'education activities is becoming an increasingly commcm activity 

a ( 

in school districts. Previously, new ideas and innovations were infused 
regularly into a school. district when it annually hired twenty to thirty' 

* percent new teachers, Declining student enrollments and resultant budget 
reductions coupled with reduced teacher turnover have greatly limited or 

ended this source of hew ideas. A second source of stimulation has tradi- 

* 

tionally been graduate education with the current ideas and practices 
developed there b^ing introduced into classrooms. However) the expanding 
pool of teachers who have obtained what they consider to be their terminal 
degree has reduced that avenue of change., If change iQ teacher behavior is i 

y * 

to be scnight in schools today, the, most common form .of stimulation will be 

v orisite inservice activities. To encourage this type of -activity federal 

dollars are being appropriated to expand, inservice education through Teacher 

[ " % Corps, Teacher Centers, 4 Public Law 94-142, and through the dissemination of • 

Title LV-C innovative, projects. . 

/This increased activity, however, has 'not" created an immediate improve- 

ment in # the quality of inservice education. Locally developed inservice 

education in 1979 Is basically designed the same way as it has been for 

\ many years. A great majority of school districts in Illinois and elsewhere 

throughout the country still operate with some or all of tfie* following too 

t 

familiar characteristics. 

v l. Inservice programs are planned, in a -disjointed fashion with little 
or no continuity from one program to -thp next. 



• 2. Inservice teacher education "is planned by either administrators 
or by an acfe^istratively selected teacher Committee with little input from 
all potential particfpants. 
•r - 3. Activities are planned without the setting of specific objectives 
and with topics which lend themselves to only shallow discussion of current 
topics in education. y 

4. Too- little time is allotted' for a thorough examination of any topic 
with little or f o^low-up provided to "support any of the new ideas generated 4 
by the programs. 

5. Participants behave basically at the end of the program in the same 
manner they did at the beginning of the effort. • 

6. Inservice education, while tolerated or, in some cases, even enjoyed 

%y teachers, £s rarely'seen by the pafticipdnts as resulting in change in their 
classroom. * " 

K If this picture of the mass of inservice teacher education is accurate, 
qhange .can occur only if inservice education is changed dramatically to 
become a systematic effort at creating behavior change in teachers and * 
eventual behavioral change in students. Efforts at implementing the types 
of programs suggested in this paper have occurred" or are occurring in 
Teacher Corps projects in Midison and East St. JLouis, Illinois, in^a 
' federally funded Teacher Center in Madison County, Illinois, and in isolated 
districts throughout the state. These embryonic efforts give some hope that 
a new approach to inservice education of teachers can emerge and hav^ a 

positive effect on what happens to students .it\ th6 classroom. 

>' . ' « 

At the heart of any such effppts aimed at improving the quality of 
~* * > 
inservice education is the need for the v developmfcnt-of -an -effective evaluation • 

model. This paper proposes a model of inservice education and presents its 



- .,t 



/implications with* analyses and recommendations for answering the following 

questions: , 

S * ' . 

1. What should be the purpose of evaluation 'in inservice teacher * 
Education? <j 

2* ' How should the evaluation of inservice education be framed? 

3. "'What aspects -of inservice education are to be evaluated? J 

4. When should evaluation of ii&ervice education take place? c 

5. Who should carry out the evaluation of inservice .education? 
* 6. How should the evaluation of inservice education be conducted' 

and analyzed?* • * 3 . 

Purposes of Evaluation , * * 

Allen (3,976) states that^ the purpose of evaluation in. inservice education 

* * * 

is decision making. Evaluation is- begun in order to enable educators to make 
informed decisions about the educational process. MacDonaltf' (1976) limits 
the scope of worthwhile evaluation to include only thoSe programs which 

are systematically designed to result in change of teacher behavior and 

> ■ 

a 1 

in student learning. Bush (1971) further emphasizes the* need and difficulty 
encountered in isolating and defining the behaviors .to be* evaluated. Without 
this effort, he contends, inservice education is difficult to improve. 



Bishop (1976) summarizes that evaluation should contribute to bqth formative 
arid summative decision making- and" to program imjJl'ovement 1 . A search of v the 
ERIC system found 165 entries describing metho4s arid/pr criteria for • 3 
evaluating inservice education. This search revealed the following 



Jnistrating--pa^terns-^oT irfieT.ocal developer of inservice < edt*cation.' . K 
1. Approximately 30 perceftt of ■ the entries* were- evaluation reports 
for federally funded, projects' sufcH as Right- to-Read, Bilimual., and 



Vocational Educational programs all of which are typically inapplicable 
to the local school setting. * 4 ' " 

4 ^--x. 



• u 



s *2.' Over *90 percent of the entries were site specific rather than 

.Relating to a general theory .or model for the evaluation of inservice - 

* f ✓ • 
education. 

3. While general,, entries focussed on'the evaluaticfc^f teacher - — 

* * * * 

behavior and changes ^n student outcomes over 50 percent of the entries, 
focussed only on the evaluation of the quality of a presentation. 

4. Twenty percent of the entries focussed on the. design of curriculum 

' . - 1 r 

with the evaluation of inservice being only incidental to the majon thrust 
of the report. • ' 

Given this brief review, several summary statements can t»e made con- 
cerning the evaluation jof inservice education ,and its potential. First, 
if inservice teacher education is to become anything beyond the one-shot 
"dog and pony shows" so characteristics of the present scene one must be 
able to demonstrate the effectiveness of an alternative approach. Without 
an appropriate" evaluation design any attefapt at demonstrating effectiveness 
of a new -approach. will not succeed. Secondly, dne mu^t look at the basic 
questiontof the role of inservice education in the school. Educators need 
to afecept the position that teachers and 'programs that do not move ahead 
stagnate and decline.* Therefore, programs must b6-develop<ed that 'focus on 
behavior and programmatic change. ^Thirdly, evaluation as currentl^ practiced 
is typically ^ used only «to justify- external^ funding or to request additional 
funding rather than as a tool for decision making and process motfif ication ( 

i • • ^ — 

If educational decision makers are to^aake Judgments for implementing change 



md-cTirricrcfljam development affecting classroom teachers, they must have better, 
dat^'on which. to judge these decisions than is currently available. . The* 



\ *. 



effective evaluation of insetvice education can serve both formative and 
summa t ive f unc jtLioas-Jji-helping-ta-^nake-t-hese^d ec islans. 



y 



A Model for the Evaluation of Inservice Education 

The evaluation model presented in Figure 0n$ involves a direct systematic 
approach to evaluation «< Xhe suggested process becomes functional once the 
program elements are defined and the, skills needed to complete each phase of 
the process are^ present, • 

The initial step which is preliminary to the actual evaluation model' is 

• 4 

the identification of the content to be evaluated. This identification should 

be determined by a needs assessment process in which all potential participants 
are- involved. This involvement creates at least an initial Sense of ownership 

* \ 

in the participants of what is occurring. An instrument such as\the*one developed 
bp the Madison County Teacher Center is a sample of how such a process can 
be initiated (Figure 'Two) . Once this area for involvement has been identified,? 
the initial step- in the inservice as well as the evaluation process is the 4 
formulation of achieveable,, measurable goals for the inservice teacher 

i 

£ education activity. The gpal or goals need. to be further defined to include 
specific behaviors to be addressed by the activity. The following .inservice 
program Resulted from this needs identification {Process. / . 
'PROGRAM TITLE : 

Contracting with Students * s - 

9 PROGRAM OBJECTIVES: 

Participant* will: * 1 

1". Identify basic characteristics' of academic and ~" 

behavioral 'contracts. * • 

2. Complete a model contract for use with their students. 

PROGRAM DESCRIPTION:- > , : — — ~- — t 



-Need-ran- effective motivation strategy for many students? Try 
contracting — the setjting -up of specif lie requirements resulting 
in pre-determined rewards. While primarily academic,- contracts 
can be used for behavioral problems. Also included in this 
session are the fundamentals of ^contracting, ideas for imple- 
mentation and* suggestions 'for what to ip and what to avoid. 



-This approach~cair~h£ contrasted ftith those consisting of only a program- 
'title being identified witri, the* evaluation of the\activity limited to 
participant reaction to the presenter. \ v 



Figure One. 
INSERVICE EVALUATION MODEL 



Need 8 
Identification 



Determination 
of 

Measurable 



*a 

Obj ectxves 



Determining 
Questions ' 
for 
Evaluation 



\ 



Designing, 
Selecting, 
Administering 
Appropriate 
Instruments 



\ 



■ Anaiy«e 
. Data 
State o 
il • Conclusions 



Disseminate 
Information/ 



Make 
Decisions 



Step One 



^St^p Two 



Step Three 



Step Four 



^Step Five 



Step Six.'' 



■ * * « Figure Two 

* - ' . MADISON COUNTY TEACHER CENTER 
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1* Curriculum Developments Adapting or developing curriculum to meet 
goals and objectives for sequential instruction. * 
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a. Provide for students to work at different rates'. 














b, Var7 jteachinj^ according to learning styles of students. 














* c. Writ£ individualized learning packages, v 














2-. Planning for Diverse. Cultural Background-Planning instruction 

% 'reflecting the* importance of various cultural grtfops in classrooms. 














3. Career Educati6nr*Ability to incorporate concepts of career education 
•±0, the cjtassroom.' * 0 














4. * Planning fof Learning Problems-Accurately interpreting results of ar 
'variety of diagnostic procedures; using referral procedures. 














5. Planning for'*Gifted Talerited-Using techniques for identification 
and "instruction of "gifted; using referral criteria. 
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6- Content Areas-Ref ining and expanding knowledge of subject matter and 
method. ' • 


a. Reading * • 
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* ^ b . Mathematics 














c: Language Arts /English* * \ ' 














f d.„ Science . 














e. Music 
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1 f . Social Studies -* 














g. Business Education/Industrial Arts 














v h. Home Economics 
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7. Environmental Education-Incorporate environmental education into the 
school curriculum. ' * - - - 
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8". Metric Education-Incorporate metric education into the school cur- 
riculum. ' * ' 
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9. Energy Education-Incorporate energy education into the school cur- 
riculum. 














10.^ Aerospace Educationnlncorporatfc aerospace education into* the school 
curriculum. . r ~ 
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11. Remedial Readin£-Wprk more effectively with slow or non-readers t . 
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Once the evalufrt^Don objectives are set and the behaviors to be observed 

are Established, step two requires the identification of appropriate* 

evaluation questions.. For example, if the objective of the inservice 

activity is to design a s learning contract* one appropriate question for 



evaluation would be whether the particip^t shad * actually .developed the 

requ&ed form. Another question might attempt -to ascertain whether the 

*\ • • 

participant could identify the basic characteristics needed in writing a 
learning contract. ' ^ • 

In order to gather d^t£ to answer these evaluation questions, step 
'three calls for the design, selection, and admirtistration-of appropriate 

instruments or procedures. ^ Once the data has been collected it needs to^ 

i 

be analyzed in terms of prescribed standards and criteria so that judgments 
can be made in terAs of the progress toward achievement of the initial 
objective o"r objectives. 

The fifth and sixth steps in the evaluation process are the dissem- 
ination of the results so that the decisions based on the evaluation can be 

^made and the activity revised, as ^necessary, to b4come^more effective in 

» / * 

the future. " ,« 

If the purposes of inservice evaluation as suggested earlier are 

1) 'to facilitate rational decision making and 2) measure change in teacher 

and/or student behavior based on assessed needs, then this e^aluatfbn 

process model is jaot only possible but necessary. ^ 

t * 

Evaluation/ however, if it is to be effective, must be used. Too 
_of ten_evalnatiaTi modefa and/or designs are-of-such-compiexity that it Is 
rarely possible for local districts to consider) their usage 1 . Because of 
this the evaluation model presented above requires the following charac- 
teristics for its implementation.- . * 

1. Form follows' function. The instrumentation ugprf mnsr h*»_ t±*d— to 



the evaluation must be time effective. The eval^£ion results 

required in inservice education must be readily obtainable within a reas6n- 

* able time so ^that the results can be used in the decision making process^. 

t 3. The evaluation. must be cost-effective. The use of an evaluation 

/ 

model must be within present budget limits in school districts in terms of 

■ > *« 

staff time\and v^echnology required foT analyses.' ■■ - f , * ^ 

■4. The evaluation must be useable: The results of the evaluation 
process must be transmittable to all participants. Complex statistical 
discussions coupled with* abstract designs need tTD be avoided. ' This caveat 
is hot-meant to suggest an anti-intelle/tual or anti-Statistical bias but 
rather reflects the concern that data must be understandable to be useable. 
Unfortunately most public school* administrators and teachers' and, in 

. r • . > . 

fact, most university faculty lack the facility to deal comfortably vith 
• ■* . • 

complex statistical language, feather than try to remove! this' barrier, it'-. ' 

is advisable tb^work within <-these constraints. Designs which require « 

external consultants for statisical support are of little ufce in locally 

♦ 0 ) 

J • * * -f t * 

developed programs. As a mite, of thumb, If the datk presented i| not 

• * , '> 

easily understandable to all teachers and administrators ,within a district^ 

it should not be used. ' ' *" * 9 - 

In order to carry out 6uch~a\ workable evaluation program^ f ive evaluation 

concerns should be addressed.. While all five are ; " vital to an effective 

4 

^ evaluation program, the Individual evaluatdr can readily "adapt the processes 
to his/her ownvneetls. f *\ k 

Evaluation Concems^n* Inservice Education" ' 

The evaluation concerns for inservice education can be approached , 

through five questions. ' , \ 

* 

1. Was the content of the inservice activity informative and useful x 



2. Wap thp presenter of the inservic^aJlfcvity, effective? 

3. Did the participants in the inservice activity exhibit the befiavior 

< * . 

change as defined by the objectives? - ' ■ " ., <* * 

*■ • v * ■ • 

4. Did the participant's behavior in their classroom change as a 

4 ' t 

result of the inservice activity after a period of tipie? 

'./-• • ' . " ' ~ • • , 

5. ~ Did the students of the participants change as a result of altered 
teacher's behavior? — L.^ ' 

Ekch of^these evaluation ^concerns is addressed in the light of the^ ^ 
issues described earlier as being .crucial to fostering changfe in insfervicp 
education. Included in this discussion ace sampl'e instruments for assessing 
these concerns, "Figure Three* summarises the concerns addressed by an in- 

^ - * s ' ' ■ . ■ - . / 

service evaluation mo3el.* 

*» - ; 

Concern One: Inservice Content - N , 

- . • " • # , f . „ * 

While the content of ,any inservice ^education Activity is often limited 

. ' * r ' * ' - 

v to the quality* of the presenter*, a separate -evaluation of tftt content 

* * * , ft * * 

'presented is a necessary ~\agk, -*The firs? step'in this evaluation is the ^ v 
identification o| the objectives^ These objectives, as identified by , th£-< 
aStiyity planners 1 and /or. presentffcr, £dpn the bases for *the evalu^Ci^i. *rhe 
questidits fo^ evaluation ok this concern include: 

».!•- Did- the content 'pres^ntpa make possible tl^attainment of the 
objectives .possiblef^by the part 

2L Was*the content presented ^pgJLicable to the participants needs? 
The .participant* in the acfcirtfiiy are the obvious evaluators -although 
.n external third 'party-ey£luator can beTtts^d. The* author has fou nd that 
an effective way o|^valuating content, has been by providing sufficient 
forms to one^dx the participants who supervises the administration of . the 
evaluation, collects the completed instrument's, arfcT returns the forms to 
person responsible for* data analysis. 




■% 






Figure Three. 
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EVALUATION-CONCERNS 


> 
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The instrument itsTLf should be as* brief as possible. As evaluatprs, 

• K 

we tend to gather much more data' than we needier use. One of the assumption 
o'f the process suggested by this. paper is that if an evaluation, system Is 
to be effective,' it hafc to'be used. If an eyaluation is to tife completed 
it needs to 6e presented* in V* form/that allows participants to complete 
their task quickly. For that rjpsoti care must be given to construct precise 
items that are coupled, directly with the questions for evaluation. t 

AC9UJ..LO v/i uuc cvaxuaLxui^ ait kauuxatcu) pl.civ.Su wu wliw *wi!S SHU wllii*. wU 

with the presenter an <^th<? person or group responsible for planning the f 
activity. Thi£ bpen system of accountability is extremely effective in • 

planning future workshops on the given topic or potentiative of* the 

> - 

presenter. Figure. Four presents a sample instrument with the results of 
an inservice workshop reported. • 

Data analyses typically need to go little further than .frequency counts 
or elementary descriptive, statistics. The frequency distribution of 
responses- coupled^ , with the derived mean provides an analysis sufficient to 
judge the content effectiveness of a given presentation. For consumers 

c 

the simple, easily understood data is, far superior to complex, time con- 
suming analyses that tend to be ignored. 

* T 

Concern Two; The. Presenter of Insetvice Education 

As stated in the previous section the analyses of the content presented 
in an inservice teacher activity and the quality of the presenter are 
closely^ related. As shown 'in figure Four data relating to each of these \ 

areas is divisible yet readily attainable. 

— 

The questions for evaluation associated with tlje concern f<?r 'the 
effectiveness of the presenter include: llf 

1. Was the presenter , well organized? ' 

2. Was the presenter easy to listen to, to work with, to participate 

with? 



Figure Four . - 
WORKSHOP EVALUATION 



Workshop Title: 
Workshop. Presenter: 
Workshop Location: 
Date: 



Individual Inctruction 



Greenville 



Winter, 1979 



The activity 'you have just completed was developed through' the Madison . County Teaaher Center. 
Your appraisal of. the activity will aid in ii^proving future 'programs developed iji this manner 

* * * 

Please rate the workshop by placing an "X" along the following continuuri. : 

The stated objectives' of the workshop were: * 

1. Identify four variables involved in developing^curriculum for personalized 
instruction. * \ 

2. „ Develop materials for individualizing instruction using the prescribed criteria. 

1. ^ How applicable to your needs were the workshop objectives? 



Very applicable , | 18- | 3 t 



t, 0 i inapplicable 



2. 'Do' you fjeel you have , achieved the objectives? 

More than expected t 17 , 4 t 0 t 0' j Less than expected 

.-3. Overall, how/io you rate the content of " the workshop^ > 

- Ekcellent l 



Mean 
.3.86 

r. 

3.81 



16 



j Poor' 



How well did' the -presenter organize the wofk^hop? 



Well organized t 15 v ] t 5 t 1* | 0 i Lacke^organffeation 



3.71 
v 



3.6) 



5. How much material was presented?,, 
Just right 
f&r time available \ 14 i 



JL 



I ; 0 i Not effective use of time 3.67 



6. How would you rate the presenter of the workshop? 

18 j_ 3 V, 0 



Fantastic |_ 



L 



0 i Terrible. 
- — 1 ^ 



7. Did the quality of the presentor help you achieve the objectives? 



' Definitely L 



18 



_L 



j Not at all 



3.8$ 



3.86 



8. Please make at least one suggestion. for improving this workshop in the future. 



.4- 



er|c. 



16 



: .>r ' . ' (SIU) 

« - . -14- * . 



3. v What effecf did the presenter have on your receptivity <*o the 
content?' t 

these questioris. As before, a useful process involves having a given 
participant administer the instrument, gather the completed forms, and 
return them to* the data anlyst. 

.In selecting items fpr this form of evaluation, care should be given to 
, separate the content from the presenter and the process used By the presenter. 
'€00 often, evaluation^! both of these areas tends to l^e based solely 01/ phe 



Participants again are the logical source of information concerning 



effectiveness of the presenter, not providing information on whether the 
content presented was adequate or not . •> 




The accountability of presenters is essential to the* success of 
inservice programs. A$ participants realize that their responses, have the 




f , effectL_of_ shaping future programs^anachoice of presenters ^„their responses-.— - 

? _ ... . - - - - ■■ . •• • ••' "-" • '** ' " * 

""sTiould freco~me more precise and. accurate. 

( ^Concern Three: The Learning of Inservice Participants — Immediate 

The evaluation of the learning of participants in an inservice program 
is rarely undertaken. While professors in a "course 11 situation are obligated 

to evaluate their students, the presenter of an inservice activity is rarely 

J - • " 

expected to evaluate the learning of participants in an inservice activity. 

This omission is understandable in the short term activity when £nter- 
tainment has a higher priority than participant behavior change. As the 
inservice model advoca^ted -by this paper is adopted, evaluation of partic- 
ipants immediately and after 'an extended period is required if any measure- 
ment of inservice effectivenesses to be obtained. Decisions based^nly on 
participant reaction to content or presented accomplish little If unaccom- 
panied by behavior change in the participants. The various theorists 
studying inservice education are unanimous in their advocacy of evaluation 
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of tgacher behavior change yet are not as certain of - how .this :c*an be don^.* 
As stated earlier, most research available on teacher behavior change as 
the resuit of inservice' activity is not easily replicable due to both the 
sophisitication of the research d'esign and the cost required to carry out 
^the required analysis. In response, this paper advocates two approaches to 
gathering this data: (1) immediately upon the- conclusion of 1 the "activity 
gathered by the presenter, (2) at a later date gathered by the -participant, 
peei^, or students. The latter approach is discussed in concefivfour of * 
this paper. . " , 

The, question for evaluation concerning teacher behavior change is 
whether the participant .has met the stated obj-ectives for^the activity. 
_ At this point there is little concern as to whether the results of the pro- 
—gram have^long trerm ^^ac^ but_wh_ether^ immediate-behavior change can be r 



observed. \ . # f 

% 'The gatherer of data for this concern must be the presenter working 
* in conjunction with the*' activity planners of the locki-dl strict. The 

instrument development should be ths^resjjonsibility of the presenter with 

' * * 

the administration and analyses left to the -local district. Instrumentation 

for this evaluation concern should be as varied as the presentations. While 
a paper and pencil test may be appropriate for certain activities, obser- 
vation checklists are appropriate for others. Figure Five suggests an » 
assessment for an activity in wMch the participant objective was to 
develop personalized instructional strategies for use in the classroom. 
A paper and pencil item measures the recall of key concepts -concerning per- 
sonalized instruction while an' observation checklist is used to check the 
product (s) developed by the individual participant. 

This evaluation concern requires a major clftmge in presenter freh'avior. 
As a stipulation for development of the activity, the presenter must not 

rIc v X8 / " 
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T Figure Five 

EVALUATION OF PARTICIPANT LEARNING: IMMEDIATE 



•Participant 
Presenter 
Date 



1. Identify the* four variables involved in developing curriculum for 
personalized instruction: 

J 

a* c. 



v b. 



— Analyz e the ma t ertal3~~dev eloped in conjunction with this activity in 
t terms of the following criteria. « 

' 4 ' Yes No 

- a. Content is determined by objectives*. * 1 1 j \ ~ 

^ b. Objectives are Anienced logically. I ) j 1 

c. Objective based pre test developed. 

□ □ 

d. Objective based post test developed. | | 1 j 

e. Activities incorpor§te Mhimum of two alternative J j f~ j 
learning styles. % ' ■ i » 

f. Classroom environment adapted to personalized f """I | I 
' instruction. ' I ■ ■ I 
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only, develop^ a meaningful activity (the usual expectation) ' but must also 
§tate meisureable Behaviors and prepare an evaluation for participants. 
The results can be presented in ^everal ways. Participant response 

* 

can be made anonymously with only a group score being analyzed. An 
alternative approach would require individual feedback to participants • 
combined with a description of group performance. 



Concern Fourr Learninft^afL^Inservlce Participants — Long-Term ~ 

4 

If inservice education is to become moite accountable, it must be shown 



that the skills, knowledge, and attitudes stated po meet the objective of 

) . 

given programs are retained by the participants after the inservice activity 

** 4 

has been complet^d^_Fqj^he^ long- term evaluation 



b o defined measurem ent of teafeher behavior a minimum of two mdnths 

after the completion^ of the activity. The question for evaluation is 

whether the behavior exhibited at the conclusion of the training activity 

is still present iji the participant in a work setting at a future date. If 

behavior change is to be sought it needs to have long term effecc. 

Traditionally, this concern has been the focus of some major evaluation 

studies but rarely of local district inservice programs,. The design used 

most commonly in large scale studies requires the nse of trained observers 

working in the classroom for an extended period of time. Obviously tHis 

design is unrealistic for the typical school setting. The approach* 

advocated in this paper suggests pie ufa^pf participant self-evaluatiOn as 

a cost effective alternative^ While presumably weaker in statistical * 

power, this approach provides available data as well as reinforcement fpr 

the presenter and/^articipant. The use of teacher self-ratings are a 

pedsona'ble approach to determing teacher behavioral change (Wilsqn and 

* Wistansley, 1976). 
m 
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After a "set period of time the person or persons responsible for 
planning a giyen inservice activity, send an instrument tt> the original 
participants which asks the' participants to self .assess their own Change 
While open to potential misuse this method involves the teach^^in. the t 
evaluation process at littlei-or. no c ost Jp ^ the district. It also con- 
tinues the participant ownership in the inservice process" begun with' the 



needs assessment. This format al§t) allows participants^ the opportunity 

' - _ "A— , 

to further reflect on the activity* within the reality of their own class- 
rooms apart from the intensity of the original setting of the inservice" 
activity. Finally, theTprocess treats professional as professionals — a 

* ■ * • . r\ 

rare- but-needed^ treatment". =— - V 



Ttie instrumentation for. this— concern can 6e either a duplication or 
adaptation of the. ite^is used at the conclusion Of the activity .itsetf 
(Figure Six?. 

The results need to be shared, with the ptesenter 1 and participants but 
more importantly should be used by the planners of inservice to' anticipate 
what to include in future programs. c - 

Concern Five; Student Behavior Change . . - ' 

t ." '• 

h MacDonald (1976) has stated that without evid3nc6 of. change in student 

. * * / 

behavior as a result of the change ,ih .teacher behavior that inservice 

education is not Worthwhile. The measure-of t^je nature of this change, 

however, is difficult to obtain using traditional mettfods. 

Vs * 

Inservice education, even whep conducted tising tbm systematic model 
proposed here can hardly be expected to result in immediate significant 

- V » 

gains in student achievement or in^ student attitude changing from hostile 
to ebullient. Additionally, when significant gains dp oemir, one must be 

^ A» 1 

very hesitant to attribute this growth to the results of a^fK^L- planned ■ 
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EVALUATION OF PARTI piP ANT > LEARNING : LONG TERM 



V?' 



Name 



,Bajte of Inservice Activity 
* Date Today 
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As a result of the workshop on personalizing instruction: , 



#!• Learning Rate 



"St udent s are given time needed to ^attain mastery of materials. 



100% of time 



0% of time 



2. Learnjj^ 




s 



The materials developed h^ve been^s^uenc^a ip terms* of measureable 
objectives. 



fS 



100%' of materials 



No materials 



v 3. t vLeariiiijtg Style 



( 



Students have learning alternatives appealing tq at least two different 
learning styles 



All the - time 



/ ' 

4.^ Clas|room Environment 



* Never 



K 



This room arrangement is changed to^meet the requirement of personalized 
instruction. * - _ / . . ' ± * « 



L 



-L 



Always 



-L 
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While traditional measures of achievement and attitude can be useful 
in identifying long term trends or in making normative comparisons, two 
' Alternative forms of evaluation seem to be of more value to teacher^ and 
-administrate at the local level. 

The 'first approach sugge^tjL-utilizing the "classroom environment" 

\ • 1 : . . ^i-- 

research model. "This approach can be used to anecdotally record changes 
* in student behavior that can be attributed to changes in teacher behavior. 
For'exam^le ifi the goal of the inservlce activity is to byild teacher 
y skill in; using positive reinforcers with slow learners, teachers can 
record their observations of student reaction to the teacher's use of 



— positive reinforcers. While not easily quantifiable, this approach pan * 
v be 'extremely valuable in documenting program effectiveness. 

Normally the teacher/participant would te the recorder of this data. 
However, ^two other sources are possible. The first would be. the ude of ah 
external observer such as a teacher colleague who would observe during -a 
planning period. Admitting that such behavior is rare, these shared o*bser- 
vatlons would be extremely valuable in building professional interactions 
in a staff.* A second^-aiternative evaluator wc^ld be tlie students in the 
classroom. Again,^ admitting the imprecision of this approach, student 
reaction can be extremely valuable at ali grade levels. Taking the use 
of reinforcement as an example, children can be asked how they -feel when 

the teacher \$omplimpnts their efforts or when he/she doesn't. Tlje rey&ponses 

) ' • - 

are effective documentation 'of the effects v^f the change in teacher behavior 

on student actions. x • 

* 

A second general approach to measuring the impact of teacher behavior 
change on student behavior would be the use of objective referenced * y 
measures tied closely to the purposes of the inservlce activity. If an ° 
inservice activity proposes providing teadhers with skills needed to .improve 

23 ■ • 
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creative writing skills in high school students a simple measure could be 
developed which would measure creative writing outp\it both before and 
after the intervention. This measure would be teacher administered pro- 
viding some gro\s descriptive data/ % & 

Any o£ these approaches bo the evaluation of inservice behavior lack 
tft^ precision required of a sophisticate^i'research program but meet the 

* \ * -* 

criteria of being useable, being^t'ime and cost effective, and of being 

'• \ • ' ' 

understandable to those involved. 

' \ 

Summ ary \ < ^ 

_ — m The evaluation of inseryiAej^duc^icmZmust^~5e -tied— tfr- an approach-to - 



the professional development of educators which involves needs assessment, 

the setting of measureable objectives, and the delivery of services tied 

specifically to the objectives.- Once this model has been adopted, a 

number of * evaluation concerns can be addressed. For the purpose of this ^ 

paper, a practical approach which requires the involvement of planners, 

♦ 

• - t • 

presenters and participants has been proposed with a focus on responses 

* \ • 

.to five b&sic concerns of the inservice evaluator. While admittedly • 
lacking in sophistication, this approach to* the evaluation of inservice 
education .can bd*readily integrated into ^ny^school setting providing ^ 
v^uable data in improving th'e quality/of education. 
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